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jSS K M AS O M fOSt Assistant Director for Sese&rch end Beports 
TBI9BGH; Chief, Bconoaic Aesesreh, CSd 

S3®JECT; Language Developsaeat Program 

wswssc&j cia asguiation 35*115 

CIA «*Ue» ^-115-£ 


1* CIA deletion 25-115, dated k Ibbruary 195?# first 
established the CIA Lanetage Development Proeprsuu Since this 
r ag a lstion was issued, certain additional steps have been taker, 
in iapiesent the language program, ia c iudia g the scheduling of 
language tests. A sisesble member of P/S£ analysts haw becosK 
dj uil with the language program as a result of these tests, 

and with shat seeat to be good reasons* I m writing this raesiorandiua 
bemuse I think a serious problem has developed sad would like to 
atapelnt you with it. 

t« CSA Setiee 25-115-2 sets forth a schedule of awards for the 
dswslcpaent of language competence and gi ves instructions for pli* 
fyiag. An essential pert of the procedure was the coup let ion of 
Item He. by each «a»loyee. Ibis fora 'calls for the esployee 
to make a selective evaluation of his ability' to read, write, pronounce 
speak, sad understand a foreign language* On the portion of the fora 
nosering reading, the employee was asked to choose among five levels of 
ability, four of which dealt with either or both (1) reading "in fields 
I m familiar with", (2) the fre<pieney of need to use a dictionary. 

Smeh of tbs other language skills had s taller grading scales. 

5* A series of tests designed to seasurc the current level of 
language proficiency of employees claiming proficiency has been partly 
completed. the tests have revealed the following serious difficulties 
with the Language Develnpaeut Progrmi 

A* Maty aagdeyee* discovered that they had misinterpreted 
the meaning of tbs' statements incited in Tom Me, For exasple, 
in at lesst one cam, a person with intermediate reading knowledge 
selected entry 2, "I can read tests of most grades of difficulty, 
ef a f^iral nature or in fields I ass fusilier with, using the 
dict ion ary occasionally'*, is the belief that this described Ms 
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level of eaaspetence. As it tamed out, this statenent wee 
intended by OTB to detffirt.be m adveaccd level of eoet^eteace, 
sad In order to reach tbit eteodam oa the test, the individual 
bed to pertoxm at higher thsa the iaterrodiete level. the 
«spl oyee, when be filled oat the fora, wet not told that tbit 
statement described advanced ecsajpeteace. 1 do not. believe it 
wet treasonable -fear bia to have ecraelu&ed that it described 
intermediate coapetenee. A n ot her analyst claimed eerapetencc 
at level 3. ^h^®wratly, be took a aam&m ecraree, sad then 
tbs test, era which be rated only level 2. Clearly, tbia analyst 
bad sot retrogressed; bis subjective interpretation of the assail 
of level 3 singly did not aatefc that of 018. 

B. Since each individual filled oat bis own fom Me <m s 
subjective basis, there was no joarsnt©© of urtforaity of iater- 
pretetlsm fxm person to- person. liras, in addition to the problem 
created for & given person as described immediately above, there 
was a prcbl«» of ccsjmrability aaong all those who filled- out tbs 
f&ra. As it earned out, there was every incentive far m irtividusl 
to rate Massif as low ss possible in order that it would be easier 
to win- m achievwsnt award. 

C* With respect to tbs resdtasi test, w^loyees ware not given 
m opportunity to use a dictionary, in spite of the fast that four 
of the etateaeasts on Sbr® Me took the uses of a d ic tion ary into 
account* Also, the two to® statenents m the reading portion of the 
fox a gave? the ea$»loyee -an alternative — be could Mala- to be abbs 
to reed ttths of aost grades of difficulty "of a general nature or 
in fields I m fbraUisr with" (esphasis supplied), fhe tests, haw- 
ever, were not in fields the individual wm fart liar with. ladeed, 
seat if not all tte reeding mterial was free literary sources, and 
often conteiisod rather obscure «od seldom used worts, Stesace, the 
reading tests: (l) did act permit use of a dictionary, (2) did not 
give tbs individual a chance to Shaw what be could do in fields be 
wss fssdlisr with, (3) used 11 ;.-er«ay araterlal vfcieh wm «®porently 
neither a fair nor a meaningful test of reading knowledge. 

%. Is summary, the criticises have been largely about the reading 
portion. of the test. 1b® basis upon which our employees evaluated their 
ability to rand the language art the basis epos t&&h their proficiency 
was test ©A ere net the sane. Bence, & comparison of the self-evaluation 
fflart the tost results fear the purpose of deienainiag a change in the level 
of proftciaracy or the maintenance of a claimed level of proficiency is 
b&rtly valid, art assarts granted on the basis of such a comparison scarcely 
cgaitablo. 

% Attached ««► BrtdMts A tbr^igb B are four caveats on the 
l4®gu«ge Sevelcjasni Program, which I solicited free fora? asemters of 
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tte Bm*toaa. 1 feel iir*» that the expressed here are rwther 

j gano r fldiy sad illustrate aiesly sarae of the problem that have 

agism. 

6„ i feelibtw that- the ecB&lai'Ste ea^reesed fey a«vaa&3.y®ts «r® 

«*>n fgasied and are deaendsis of attention at the fclghdevela* I 
would either recoaBjead that employees fee given an qpportuailqr to- daaai* 
strata their t m Mm ehility in field* they ere familiar with while ml m 
& dietloaary* car that mam of the afevlcuai iate^piiies la t l^ pr ogram to 
late fee cormyted fey administrative actio* to fee agplied retroactively. 
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